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Abstract 

Let Xi,...,Xn be some i.i.d. observations from a heavy tailed distribution 
F, i.e. such that the common distribution of the excesses over a high threshold 
Un can be approximated by a GeneraUzed Pareto Distribution G~,.a„ with 7 > 0. 
This paper deals with the problem of finding confidence regions for the couple 
(7,CTn) : combining the empirical likelihood methodology with estima tion equa- 
tions (close but not identical to the likelihood equations) introduced bv lj. Zhang I 
(|2007i ). asymptotically valid confidence regions for (7,o-„) are obtained and proved 
to perform better than Wald-type confidence regions (especially those derived from 
the asymptotic normality of the maximum likelihood estimators). By profiling out 
the scale parameter, confidence intervals for the tail index are also derived. 

1. Introduction 

In statistical extreme value theory, one is often interested by the estimation of the so- 
called tail index 7 — 7(F) of the underlying model F of some i.i.d. sample {Xi, . . . , X„), 
which is the shape parameter of the Generalized Pareto Distribution (GPD) with distri- 
bution function (d.f.) 




The GPD appears as the hmiting d.f. of excesses over a high threshold u defined for 
a; > by 

Fuix) := F{X - u < x\X > u), where X has d.f. F. 

It was established in |j. Pickands (1975) and A. Balkema and L. de Haan ( 19741) that 
F is in the domain of attraction of an extreme value distribution with shape parameter 
7 if and only if 



lim sup 

u^s+{F) Q<x<s+{F)-u 







(1) 



for some positive scaling function a{-), where s^{F) — supjx : F{x) < 1}. This suggests 
to model the d.f. of excesses over a high threshold by a GPD. This is the P.O.T method. 



Some estimation methods for the couple (7, a) in the GPD param etrization have been 
proposed. We can cite the maximum likelihood (ML) estimat ors of R. L. Smith ' (l9S 



or the pro bability weighted moments (PWM) estimators of I J. Ho sking and J. Wallis 



El 



(|1987| ) . In I J. Zhang I (|2007l ) , the author proposed new estimators based on estimating 
equations close to the likelihood equations. Using the reparametrization b = —"f/cr and 



considering Xi 



, Xn i.i.d. variables with distribution G-y.o- with a a fixed value (which 



is an important restriction if the aim is to prove asymptotic results) , he based his method 
on one of the likelihood equations 



1 

7 = — 5]log(l-6X,) 

i=l 

and on the empirical version of the moment equation E((l — bXiY) 



(2) 



or 

for some parameter r < 1. 
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(3) 



^ and ^ yield the estimation equation for h 
1 



1 



0, provided b < X^^^ and r < 1. (4) 



An estimation of 7 is then deduced from ([2]) and a is estimated using b — —j/a . 
Zhang proved in I J. Zhang (|2007h (Theorem 2.2) that for a GPD(7, cr) sample with 
7 > —1/2, the estimators he proposed for 7 and a are jointly asymptotically normally 
distributed and that they share none of the following drawbacks of the ML and PWM 
methods : theoretical invalidity of large sample results for the PWM estimators with 
large positive 7, and computational problems for the ML estimator. 

In this paper, we consider the classical P.O.T. framework, where an i.i.d. sample 
Xi,...,Xn with distribution F is observed and, according to ([T]), a GPD G^.cr(„„) is 
fitted to the sample of the excesses over a large threshold w„. Noting (t„ = cr(u„), our 
goal is to build confidence regions for the couple (7, (Tn) (as well as confidence intervals 

2 



for the tail index 7) for heavy-tailed distributions (7 > case), starting from Zhang's 
estimating equations; therefore the excesses will be approximately GPD distributed and 
the parameter ct = (J„ will be varying with n. To the best of our knowledge, little 
attention has been paid to the subject of joint confidence regions (and their coverage 
probabilities) for the couple (7,(T„), especially outside the exact GPD framework. 

An obvious approach to obtain confidence regions is to use the gaussian approximation. 
In this work, we consider an alternative met hod, namely t he em piric al likelihood method . 
This method was developped by Owen in A.B. Owen ( 1988f) and A.B. Owen I (Il990h . 
for the mean vector of i.i.d. observations and has been exten ded to a wide range of ap- 



plicat ions, particularly for generalized estimating equations (|Y. S. Qin and J. Lawless 
(Il994h ') . 



In IJ.C. Lu and L. Peng I (|2002f) , this method was applied to construct confidence inter- 
vals for the tail index of a heavy-tailed distribution (empirical likelihood estimator of the 
tail index being equal to the Hill estimator). It turned out that the empirical likelihood 
method performs better than the normal approximation m ethod in terms of coverage 



probabilities especially if the calibration method proposed in lL. Peng and Y. Oi I (|2006[ ) 



is adopted. We will see that it is even more the case for confidence regions. 

In Section 2, we explain the empirical likelihood methodology based on Zhang's equa- 
tions (0) and (HI) , and present some asymptotic results. A simulation study is conducted 
in Section 3, which compares different methods for constructing confidence regions for 
the couple (7,(T„), as well as confidence intervals for 7 alone, in terms of coverage prob- 
abilities. Proofs are given in Section 4 and some details left in the Appendix. Technical 
difficulties are mainly due to the fact that one of the parameters and the distribution of 
the excesses are depending on n. 



2. Methodology and statement of the results 

2.1. Notations and Assumptions 

In this work, the tail index 7 is supposed to be positive and F twice differentiable 
with well defined inverse F~^. Let V and A be the two functions defined by 

U"{t) 



U{t) ^ F-'{l/t) and A{t) 



U'{t) 



1 



7, 



where F ~ 1 — F. 

We suppose the following first and second order conditions hold {RVp below stands for 
the set of regularly varying functions with coefficient of variation p) : 

limi^+00 A{t) - (5) 
A is of constant sign at 00 and there exists p < such that \A\ E RVp. (6) 



A proof of the following lemma can be found in lL. de Haan I (|1984[ ). 

Lemma 1. Under and Q we have, for all x > 0, 
'U{tx)~U{t) xT- 



tU'{t) 



/ A{t) — > Kj^p{x), as t ^ +00, 



(7) 
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where Kj_p{x) := ^ J" ^dsdu, and the following well-known Potter-type bounds 

hold: 

Ve > 0, 3^0, yt > to, Vx > 1, 

^ (8) 

2.2. Confidence regions for the couple (7,ct„) 
For some r < 1 and positive y, 7, a, let 

log(l +7y/cr) - 7 \ 



5(2/, 7, ct) := 



(1 + ly/aY^-^ - a 



l-r 



Note that, if Zi, . . . , Z„ are i.i.d. GPD( 7, a), then ■^J2"^ig{Zi,j,a) = summarizes 
equations © and © of I J. Zhangi (|2007t ). 

Let Xi, . . . , X„ be i.i.d. random variables with common d.f. F (satisfying the assump- 
tions stated in the previous paragraph), and 70 and cro(-) be the true parameters such that 
relation ([T]) is satisfied. For a fixed high threshold m„, consider the Nn excesses Yi . . . , Yj^^ 
over Un. Conditionally on Nn — kn, Yi . . . , Yfe^ are i.i.d. with common distribution func- 
tion which , according to (H]), is approximately G-y^.o-g,^, where cron ■= craiun). The 
objective is to estimate 70 and aon. 

Let Sn denote the set of all probability vectors p = {pi, . . . ,pk„) such that Pi — ^ 

and Pi > 0. The empirical likelihood for (7,17) is defined by 

L(7, cr) := sup I ri^'^ y/ P ^ ^^"^ Y^^Pi9iYi,l, ct) = | 

and the empirical log likelihood ratio is then defined as 

lil:<^) ■= -2(logi(7,o-) - l0gi(7„,(T„)) 

where (7^, tT„) are maximising £(7, cr), and are called the maximum empirical likelihood 
estimates (MELE) of the true parameters 70 and aon ■ 

Since Theorem 2.1 of I J. Zhang implies that, for r < 1/2, there exists a unique 

and easily computable solution (jmO'n) to the equations 

^ log (1 + -/Y,/a) -7 = and ^ (1 + ^Yjay/'' - = 

i—l 2—1 

i.e. such that k^^ X^i^i .9(^ii 7«i '''n) = 0: it thus comes that L{'^n, o'n) = ^,7*^" which is 
equal to max-y^o- ^(7, cr) : the MELE estimators (7„, therefore coincides with Zhang's 
estimators. 

Note however that Zhang worked in the purely GPD framework and that the application 
of his results for constructing confidence regions, based on the asymptotic normality 
of (7n,(Tn), necessarily involves some additional covariance estimation. Our aim is to 
construct confidence regions for (7,ct„) directly, relying on the asymptotic distribution 
of the empirical likelihood ratio ^(7o,co,i) stated in the following theorem. Classical 



advantages of proceeding so are well known : a first one is the avoidance of information 
matrix estimation, a second one is the guarantee of having the confidence region included 
in the parameter space (as a matter of fact, in our case, the parameter a is positive but 
nothing guarantees that the confidence region for (7,cr), based on the CLT for (7„,(t„) 
will not contain negative values of a) . Note in addition that our result is proved in 
the general framework {i.e. when the excess distribution function is supposed to be only 
approximately GPD) and that simulation results show some improvements in terms of 
coverage probability (see next Section). 

Note that the empirical log -likelihood ratio IH ^a) ~ — 2 log(A;^"L(7, cr)) has a more 



explicit expression : foUowing lA.B. Owen I (|199Cl[ ). the Lagrange multipliers method yields 



k„ 



A:„(l+ < A(7,(T),5(rj,7,cr) >) f-^ 
where A(7, cr) is determined as the solution of the system 

k 

^ 1^ (1+ < A(7, a), g(y„ 7, a) >)-' g{Y,, 7, a) = 0. (9) 
i=i 

Let an := A{l/F{ur,)). 

Theorem 1. Under conditions and (d^, with 7 > 0, conditionally on Nn ~ kn, if we 
suppose that fc„ tends to +00 such that ^/k^On goes to as n ^ +00, then for r < 1/2 

^(7o,o-0n) ^ X^(2), asn^ +00. 

This result is the basis for the construction of a confidence region, of asymptotic level 
1 — a, for the couple (7o,o'o,i) which consists in all (7,(7) values such that l{'y,a) < Cq, 
where Cq is the 1 — a quantile of the X^(2) distribution. 

Note that \/k^an was also assumed in IJ.C. Lu and L. Peng I ()2002l) . 



2.3. Confidence interval for 7 

For a fixed parameter 7, we note a-y the value of a that minimizes Z(7,cr). Then, 
l{'~f,aj) is called the profile empirical log likelihood ratio. The following asymptotical 
result is the basis for constructing the confidence intervals for the true parameter 70 of 
the model. 

Theorem 2. Under the same conditions as Theorem]^ i/r < 1/3 then, conditionnally 
on Nn = kn, 

^(70,0-70) X^(l), as +00. 

This result yields as a confidence interval with asymptotic level 1 ~ a for the tail index 
7o, the set of all 7 values such that Z (7,(77) < Cq,, where Ca is the 1 ~ a quantile of the 
X^(l) distribution. 

Remark 1. Note that the restriction r < 1/3 could be reduced to r < 1/2, but this 
would unnec essarily complica te the proof since most of the time r should be chosen 



negative f see I J. Zhang I (|2007f) for a discussion). 
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3. Simulations 



3.1. Simulations for the couple (7, cr) 

In this subsection, we present a small simulation study in order to investigate the 
performance of our proposed method for constructing confidence regions for the couple 
(7o,cron) based on empirical likelihood techniques (Theorem [T|). We compare empiri- 
cal coverage probabilities of the confidence regions (with nominal level 0.95) produced 
by our empirical likelihood method (EL(0.95)), the normal approximation for the Maxi- 
mum Likeli hood estim a tors ( ML(0.95)) and the normal approximation for the estimators 



proposed in lJ. Zhang I ()2007l ) (Zhang(0.95)) 



3_(^ 

m 



Before giving more details on the simulation study, let us make the following remarks. 



Remark 2. The CLT for the GPD parameters stated in IJ. Zhang I (|2007l ) has been 



proved when the underlying distribution is a pure GPD : using Theorem 2.1 in lJ. Zhang 



( 2007t ) (which asserts the existence and unicity of the estimator), and following the same 



methodology that led to Proposition [2] in Section 14.11 the consistency of the sequence 
(7,(T„) can be obtained (details are omitted here) and accordingly, by classical meth- 
ods, the asymptotic normality follows in the general case of the underlying distribution 
belonging to the Frechet maximum domain of attraction (assuming that y/k^On — > 0). 
We will therefore use the convergence in distribution of \/k^{^ — 70 , On/cron — 1 ) to 
A/'2(0,S(7o,r)), where 



S(7,r) 



(1 - r)(l + (272 + 27 + r)/(l - 2r) -1 - (r^ 7^ + 7)7(1 - 2r) 
-1 - (r2 + 72 + 7)/(l - 2r) 2 + ((r - 7)^ + 2"f)/{l - 2r) 



and consider the corresponding Wald-type confidence region, based on approximating 
the distribution of the statistic \\^/k^{Y,{'^,r))~'^/'^{^ — , (5-„/(Ton — 1 )||^ by x^(2). The 
same methodology is appli ed for constructing c onfidence regions based on the Maximum 



Likelihood estimators fsee lR. L. Smith I (jl98l1) ) 



Remark 3. Th e tuning parameter r in (|4|) is chosen equal to —1/2 (as suggested in 



J. Zhang I (|2007r) . without any prior information). The empirical likelihood confidence 
region is ba s ed on a Fisher calibration rather than a calibration, as suggested in 



A.B. Owen I (|l99(/) : concretely, this means that our confidence region consists in the set 



of all (7,cr) such that ^(7,0-) < / where P( (2(fc„ - 1)/(A:„ - 2))i^(2, /c„ - 2) < / ) = 0.95. 
Indeed, it has been empirically observed that it (uniformly in fc„) produces slightly better 
results in terms of coverage probability. 

The simulations below are based on 2000 random samples of size n = 1000, generated 
from the following two distributions: the Frechet distribution with parameter 7 > 
given by F{x) = exp(— a;~^/'>') (the results for 7=1 and 1/4 are presented) and the 
Burr distribution with positive parameters A and r given by F{x) = (1 + a;^)-i/^ (the 
results for (A,r) = (1, 1) and (2,2) are presented). Note that the tail index for the Burr 
distribution is 7 = (Ar)~^. 

Coverage probabilities EL(0.95), ML(0.95) and Zhang(0.95) are plotted against different 
values of fc„, the number of excesses used. Figure [T] seems to indicate that our method 
performs better in terms of coverage probability, and additional models not presented 
here almost always led to the same ordering : EL better than the bivariate CLT of 
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Zhang's estimator, itself better than the CLT for the MLE. However, we have observed 
that the overaU results are not very satisfactory when the tail index 7 is small. 





lumte' of excesses number oFeacesses 



(c) Coverage Probability for Frechet(l) model, (d) Coverage Probability for Frechet(l/4) 
n = 1000 model, n = 1000 

Figure 1: Coverage Probability for Burr(l, 1), Burr(2,2), Frechet(l), Frechct(l/4) as a function of the 
number of excesses kn- The dashed line is for ML, the thin solid line for Zhang, and the thick solid line 
for EL. 

One can wonder if the improvement in coverage probabilities is due to the fact that our 
confidence regions are wider than in the ML and Zhang cases. In practice, it seems in 
fact that the three confidence regions have comparable sizes (our confidence region being 
even a bit smaller). Figure [5] shows these three regions for a simulated Burr(l, 1) random 
sample with n = 1000 et kn — 200. 



Remark 4. it should be noted that some computational problems occurred when trying 
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Figure 2: Confidence regions for a sample of Burr(l, 1). The thinner line is for ML, the thicker one is 
for EL and the other for Zhang. 



to calculate the maximum likelihood estimators. This explains why in some of the figures 
above, a piece of the curve is lacking for the smaller values of fc„ (the computation was 
performed by using the function fpot of the evd package of R). 



3.2. Simulations for ^ 

In this subsection, we present another small simulation study which is now concerned 
by the performance of our method for constructing confidence intervals for the tail index 
7 based on profile empirical likelihood techniques (Theorem [2]) . We compare empiri- 
cal coverage probabilities of the confidence intervals for our empi rical profile likelihood 
metho d (ELW(0.95)), the empirical likelihood method proposed in lj.C. Lu and L. Peng 



(|2002f ) and based on the Hill estimator (ELP(0.95 ) ) and finally the normal approxima 



tion for the estimator of 7 proposed in J. Zhang! (j2007l) (Zhang(0.95)). Note that for 



ELP(0.95), we used the exponent i al cali bration in order to calculate the critical value, as 



prescribed in lL. Peng and Y. Qi I (|2006l ). As before, the Fisher calibration was preferred 
to the one in order to compute the critical value in our case. We worked with the 
same two distributions as in the couple case : the results are presented for 7 = 1 and 
1/4 in the Frechet case and (A, r) = (1, 1) and (2, 2) in the Burr one. 

Empirical coverage probabilities are plotted against different values of fc„ . Contrary to the 
couple framework. Figure [3] shows no significant improvement with respect to Zhang's 
CLT based confidence intervals, which itself shows some problems of undercoverage. 
The EL-based confidence intervals of Lu, Peng and Qi, show quite satisfactory coverage 
probabilities, but on a range of values of fc„ which is sometimes very narrow (which is a 
common phenomenon in POT methodology) : this drawback is much less present for the 
confidence intervals based on Zhang's equations, which show a better stability against 
the choice of fc„. Moreover, simulations (not presented here) showed that the widths of 
the ELP interval and the ELW interval are comparable, and smaller than the width of 
the interval based on Zhang's CLT. 





Figure 3: Coverage Probability for Burr(l, 1), Burr(2,2), Frechct(l), Frechet(l/4) as a function of the 
number of excesses The dashed hne is for ELP, the thin sohd hne for Zhang, and the thick solid 
line for ELW. 
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Remark 5. the computation of the profile empirical likelihood Z(7o, d'jg) was performed 
using a classical descent algorithm, taking profit of some convexity properties of the 
profile empirical likelihood function. Computational details and files can be obtained 
from the authors (some of them are downloadable on the first author's webpage). 



4. Proofs 

Note that we will prove Theorem [5] before Theorem [T] because its proof is more 
involved and largely includes what is needed to prove Theorem [1] 

Proof of Theorem\^ 

From now on we work conditionally on {Nn — k„} for some given sequence (fc„) 
satisfying \fk^an — >■ as n— > oo. 

Let Ui, . . . ,Uk„ denote independent uniform random variables on [0,1]. Noticing that 
(Yi, . . . , Yfe„) has the same joint distribution as (Yi, . . . , Yfc„) defined by 

F-^'m = Uil/iU,F{un))) - U{l/F{u„)) 

we see that it suffices to prove Theorem [2] with % replacing Yi in the definition of the 
empirical likelihood. For simplicity we will write Yi instead of Yi in the sequel (note that 
these random variables are i.i.d. but their common distribution varies with n). 

Now, defining Zi^„ := Yi/aon, Xo{0) := A(7o,cron^') and go{z,t) := g{z,^o,t), we see that 
goiZi^n,0) = .g(Fi,7o,CTo„6'), hence 

^o(^) lho,<JQn9) - 2^*^^ilog(l+ < A(7o,ao„(?),.9(r„7o,ao„0) >) 

With these preliminaries in mind, we thus need to prove that there exists some local 
minimizer 6 of la{-) in a neighborhood of 9q = 1 such that la{9) — > X^(l) in distribution, 
because /o(^) = ^(70, (J-yg) with — a^g/aon- 

We now state in the following proposition some important results, which will be proved 
in Section 14.21 and will enable us to proceed with the proof of Th eorem [2] following a 
plan very similar to that found in Y. S. Qin and J. Lawless ( 1994h (note that here the 



parameter is one-dimensional whereas the estimating function go is M^-valued). We first 
introduce some important notations : 

'^n{9) ■■= ■^YA=l9'd{Zi^ri,9) 

Bn{9) := ^J:tl9oiZ^^n,9)igo{Z,,n,9)y 

M9) i:J:tl^iZ^,n,9) 

Mn{9) := max,<fcJ|5o(^»,n,6')ll 

Note that, although the new parameter 9 is scalar, we will write below |16'|| instead of 
\9\ in order to emphasize the fact that the arguments described below can be applied 
to more general frameworks. The same is true about the fact that we use below the 
notation 6q instead of simply the number 1. 
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Proposition 1. Suppose the assumptions of Theorem\^ are valid, and Z is some random 

-I/O 

variable distributed as G^o-i- V '■— € — ^o|| ^ kn }, then we have, 

conditionally to {Nn = kn} and as n-^ oo, 



G,i(6'o) 


= o(fc,-i/2(loglogfc„)i/2) a.s. 


(10) 




Af{0,B) 


(11) 


MM 


= o{\/kn) a.s. 


(12) 




= o{kl/^) a.s. uniformly on Bn 


(13) 


An{e) 


= A + o{l) a.s. uniformly on Bn, 


(14) 


Bn{e) 


= B + o{l) a.s. uniformly on Bn 


(15) 


Gn{0) 


= Gn{Oo) + {A + o{l)){0 - Oo) = 0{k-^'^) a.s. unif 


on Bn (16) 



where 



and 



B := ^[go{Z,ea)[go{Z,ea)f] - 



2 ir 
7 (l-j.)2 

7r 

(1-r)^ (l-2r)(l-r)^ 



7 
7 + 1 



\ (l-r+7)(l-r) J 

Recall that Ao(0) is defined as the solution of the equation 

— Y^{\+<\g^(Z,,n,e) >) '5o(^^n,0) =0. 

2 — 1 



Therefore, for 9 £ Bn, if u = \i}{6) j \\\q{9)\\ , usual calculations (see I A. B. Owen I (|l990l ) 
for instance) lead to 

||Ao(0)|| {u'Bn{e)u - Mn{e)\\Gnm\) < \\Gn{0)\\ (17) 

for any n. Statements (HH), (HI]), (HI]) and ([15]), dH]) thus respectively yield 

||Ao(6io)|| = 0(A:,7^/^) a.s. and ||Ao(6l)|| = 0(fc-i/3) a.s. uniformly on 6„. (18) 
Consequently, if we note 7i,„(0) :— < \a{6), ga{Zi,n,d) >, we have 

max |7i^„(6')| < ||Ao(0)|| Mn{0) — o(l) a.s. and uniformly on Bn (19) 

and, using (1 + x)~^ = 1 — x + x^{\ + x)^^ and the identity — fc^^'^X^t^ill + 
li.n{0)y^ go{Zi^n,d), we readily have 

\^{e) = {Bn{9))-^Gn{0) + {Bn{9))-^Rn{e) 

where Rn{9) = fcn^I]j^=i(l + 7i,n(^'))~^(7i,n(^'))^ffo(-^i,n, 6*)- Since for n sufficiently 

large we have ||i?„(0)|| < 2fc-iS^^i ||Ao(0)P||go(^i,n,0)f < 2||Ao(0)fM„(0)ir(i?n(0)), 
relations (fT2|) . (fT3)) . (jl5p and (IT8|) imply the following crucial relations (the second one 
holding uniformly in G Bn) 

Xo{eo)^{Bn{0o)r'Gn{Oo)+o{kn'^^) a.s. and Ao(0) - (B„(0))-iG„((?)+o(fc-i/3) a.s., 

(20) 
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Using the Taylor expansion log(l + x) = x — ^x^ + ■^x^ii + ^ (fo^ some f between 



and x) and statement (|19p. we can proceed as above and obtain 

loie) - 2gl0g(l+7,.„(e)) = 2Y,1^A&)-Y.(^^,nm' + KM 
i—1 i—1 i—1 

where, forn sufficiently large, \\K{9)\\ <fEti l7»,nWI' - o(l) E^=l(7^,n W)'- Using 

_____ ______ 1/3 

relation (^0)) as well as ([TC]) and (fTB)) . we have for ||6' — ^oH < fcn , 

^7.,«W = fc„Ao(0)*G„(e) = fc„(G„W+o(fc~i/3))t(B„(0))-iG„(0) 

= fc„(G„(^))*S-iG„((?) + o(fcy3) 

and similarly, Etiil^A^)? = fc«(G„(0))* G„(0) + o(fcy'). Therefore, if 9 = 
6'o + ufc„ ' with ||u|| = 1, using and the almost sure bound pH)) for G„(6'o), we 
obtain 

lo{e) = K{Gr^{0)Y Gn{0) + 0{kl/^) 

= kl,/'[kl,/'GM + iA + o{l))uY S-i[fcy3G„(0„) + (A + o{l))u] + o{kU^) 
= k]l^u'A'B-^Au + o{k]l^). 

Consequently, if a > denotes the smallest eigenvalue oi A and e e]0, a[, we have 

for n sufficiently large 

^o(^) > (a — e)^^'^ almost surely and uniformly for Q e cl(Bn). 

On the other hand, we obtain in a similar manner 

W^) = (v^G„((?o))*B-i(V^G„(0o)) + o(l) (a.s.) 

which converges in distribution to x^(2) in view of ([TT|). and is also o(loglogfc„) almost 
surely, thanks to pUj) . 

We have thus proved the following 

Proposition 2. Under the conditions of Theorem\^ and as n— > oo with probability one, 
the empirical log-likelihood ratio lo{-) admits a local minimizer 6 in the interior of the 
ball Bn = { 6 £ M. ; \\6 — 9o\\ < kn }. This means that almost surely, for n large, there 
exists a local minimizer a-yg of the profile empirical log-likelihood a i— > Z(7o,(t) such that 

— 1/3 

(T-yg/cToji is close to 1 with rate kn 

Now that we have identified some empirical likelihood estimator 9 and proved it 
consistently estimates 9q, we want to identify its asymptotic distribution, which will 
enable us to obtain the convergence in distribution of Iq{B) towards 
As it is done in lY. S. Qin and J. Lawless I (|l994l ). we introduce the functions defined on 
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k 

i—l 

i—l ^ ^ 

and see that {W) Qi,n{0,Xo{0)) = (by definition of Ao(6l)), Qi,n{0,Q) = G„(6'), and 
Q2,n{S^Xo{e)) = {dlQ/d0){e), wliich is null at 6* = ^. 

A Taylor expansion of and Q2.n between {Oo,0) and {d,Xo{d)) shows that there 

exists some (0;, a;) satisfying II ^?;-^^o 1 1 < ||^-^o|| < kn^^\ \\X*J < ||Ao(0)|| ^ 0{kn'^^) 
(thanks to Proposition [5] and dTSl) ). and such that 



\ _ f Qi.n{0,Xo{0)) \ _ f QiAM 



— Sn{0*,X* 



70 



) \ Q2As,Xo{e)) J V Q2,„(^?o,o) ; V Xo{0) 

where 



Sn{0,X) 



Differential calculus leads to 

't^I^iii ff(^i,n-^o) -i:;^Y.i=i 9{Zi,n,do){g{Z.,,n,0Q)Y 



-^E'=l(if(^..n,^0))* 



thus, defining V :— {A'^B ^A) ^, relations ([T5|) and ([T^ imply that Sn{Oo,0) converges 
to the matrix 

' -A B 
-A* 



S = 

which is invertible with 



1 _ 














-A 



~VA*B-^ -V 
B-^{I - AVA*B-^) -B-^AV 

After tedious calculations and use of many of the statements previously derived from 
Proposition [U it can be proved that ||5'„(0*, A* ) — S'„(0o, 0)|| = op(l) as 00. Conse- 
quently, we obtain, for n sufficiently large 

We already know that 5„ = 0(fc„^^^), but now (j21D implies that 5„ = 0(fc„^^^) and 
therefore we have proved that 

^{0 - do) C^GM + op(l) 4 Af{0, CBC') = AA(0, (A*B-M)-i) (22) 

/fc;^Ao((?) =i;yfc^G„((?o) + op(l) 4 AA(0,i;B£;*) -AA(0,£;) (23) 

where we have used the fact that the matrix E is symmetric and such that EBE — 
E, because I — AVA'^B"^ is idempotent (note that the rank of i? is 2 minus that of 
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AVA^B-^, i.e. rank{E) = 1). 

Applying relation (fTO]) io 6 = 6, relation yields 



(/ + AC)VfcnG„(eo)+op(l) 

= BE{y/KGn{eo) + or{l)) 

and this leads to the following appropriate development for h{d), using (^5]) and ([T5|) : 

?o(^) - 2fc„(Ao(^))*G„(0~) - fc„(Ao(^))*S„(^)Ao(^) + K(^) 

= (v/^G„(^o) + op(l))*(£;Bi;)(v/A~G„(0o) + op(l)) + op(l) + 

= (V^G„(0o))*£^(Vfc^G„((?o)) + op(l) + R'M 

where |K(^)I < E"=i(7»,«W)' = o p(l) ((7fc; :G„(go))*£;(Vfc;G„(go)) + op(1)). 

According to proposition {viii) p. 524 of S.S. Rao ( 19841) . since y^Gnido) converges 
in distribution to Af{0,B), and EBE — E with rank{EB) = 1, the quadratic form 
{\/k^Gn{Oo)y E{y/k^GniOo)) converges in distribution to x^(2 — 1) = x^(l), and Theorem 
[5] is proved. 



4.2. Proof of Proposition]^ 

Note that throughout the whole proof, we will write 7 instead of 70 for convenience. 

4.2.1. Proof of 03) and OIP 
Let us define 

Z, = ^^^—1 and A,(0) = go{Z,,^,e) - go(^., e), 
7 

so that {Zi)i<,i<kn is an i.i.d. sequence with common distribution GPD(7, 1) and 

G„(0o) = 7^ E 9o{Z^,0^) + ^Y. ^*(^o)- (24) 

z— 1 z— 1 

If r < ^, _S is well defined as the covariance matrix of ^o('2'i,^o) straightforward 
calculation gives the expression of B)^ and consequently the LIL and CLT imply that 

^X]5o(^.,eo) = o(fc-i/2(i^gl^g^^)i/2\ -^Y.go{Z„9„)^M{0,B). 

Therefore, according to (1241) and to the assumption \/k^an — > (as n. — > +00), in order 
to prove (|TTO and (|TT|) it remains to establish that 

-^|^A,(eo) = 0(a„) a.s. (25) 

Since we can take cron co(wn) = 'W^T^^' {^/^{"^ri)), and recalling that we consider 
Yi = U{l/{UiF{un))) - U{l/F[un)), the application of the Potter-type bounds ^ to 
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t = 1/F(un) and x — 1/Ui yields, for all e > and n sufficiently large, 

(1 - e)U^K^Jl/U,) < ~ ^' < (1 + e)U~'K^Jl/U,) a.s. (26) 

In the sequel, we will consider a„ > for large n (the case a„ < being similar) and 
note Ki = Kj,p{l/Ui), as well as Aj{d) and A'f{d) the two components of Ai{9). 

(i) Control of Ai(6lo) 

Aliea) = ln(l + 7Z„0-ln(l+7Z0 = In (1 + 7(77 (Z,,„ - Z,)) . 
Use of ([26)) leads to the following bounds (for all e > and n sufficiently large), 

— In (1 + a„7(l - e)U^^'K,) < < — In (l + a„7(l + e)U^"K^) a.s. 

(27) 

If we set B+ 7(l+e)[/7"'iv:, and Br ^{1-6^^+" K,, LemmasElandE] (stated 
and proved in the Appendix) imply that Bf and B~ are both square integrable 
and therefore maxi<fc^ cinB^ and maxi<fc^ anB~ are both, almost surely, o(-y/fc^a„), 
which is 0(1) according to our assumption on (A:„). 

Consequently, the inequality "^x < ln(l + a;) < x (Vx G [0, 1/2]) yields the following 
bounds, for all e > and n sufficiently large, 

i—l i—l i—l 

and therefore, for every e > 0, 

l'ra-mur'K,)< liminf^E-=i^ 

< limsup^E-ii^ <j{l + e)E{Ur'K,). 
Letting e go to gives a^^k^^ J2i=i ^K^o) = 0(1) a.s. 

(ii) Control of Af(6lo) 

A?(0o) = {l+jZ,,r.Y^^ ~ii+jz,y^'' = (7-^ ((l+7[/7(Z,,„-Z,))''/^-l) . 
In the case r < (the case r > is similar), use of (j26l) yields the following bounds 



for all e > and n large 

U. 



< ^ < ^ ((1 + (1 - e)ja.,Ur'K.Y^'' - l) (29) 



The inequality ax < (1 + a;)" - 1 < acx (Va; G [0, 1/2], where c = (|)"~^ > and 



a = r/7 < 0) yields, for all e > and n sufficiently large. 



2—1 2—1 2=1 
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Once again, Lemma [3] ensures that E{Ur''^'K,) and E{{Ur''^'K,f) 

are finite 

(because r < 1/2), hence for sufficiently small e > 

k„ 



r{l - e)E{Ur''^'Ki) < liminf ^ V 



A 



kji (In 

k„ 



2 



< lim sup Y < rc(l + e)E(C/7-'-^i^i) a.s. 



k 

Letting e go to yields a^^^^^ (^o) = a.s. and therefore (^5]) is 

proved. 

4.2.2. Proof of and 

With Ai(0) and Zi being defined as previously, we have 

Mn{0) = max||5o(^^,«,e)|| < max ||go(^i, ^)|| + max || A,(0)| |. 

Since the variables go{Zi,0o) are square integrable, it comes (Lemma [S]) 

ma,x \\go{Zi, 0o)\\ ^ o(^/k^) a.s. 

i<kn 

On the other hand, part 1 of Lemma [2] implies that for 9 in S„, ||(7o(2,^)|P < ^1(2;), for 
every z > and n sufficiently large. Since the variables Gi{Zi) are i.i.d. and integrable 
(part 4 of Lemma ^ , using Lemma [S] we thus have 

max||5o(^i,6')|| = o{kl^/^) a.s. 

i<kn 

We can now conclude the proof of (|12p and by showing that, uniformly for in 
maxi<fe^ |A^(6')| tends to almost surely for j ~ I or 2. Reminding that 'yZi = L^-^"^ — 1, 
we can show that 

AUe) = ln(^l + 7^)-ln(^l + 7f ) = \n {l + jU^l + {0 - iWlr' {Z,,, - Z,)] . 

Let (5 > and e]l — (5, 1 + Using (j26l) . we have the following bounds (for all e > 
and n sufficiently large). 



(31) 

where we supposed that a„ > (the other case is very similar). Proceeding as for the 
handling of Aj{9Q), and using |a; < ln(l + x) < x for x € [0, 1/2], we obtain : for all 
S > 0, 6 £]1 ~ 5,1 + S[, e > and n sufhciently large. 



Since ((32)) ensures that is of constant sign, for n large enough we have 

lAi^flM^ /1~ / 1 + e \ maxi<fe„ /77"'ifi 
sup max I Aj (6^)1 < v«na„7 a.s. 
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We conclude using Lemmas [3] and [5] and assumption yHt^an — >■ 0. The proof for Af{9) 
is very similar. 

4.2.3. Proof of and (B^ 

Recall that A„(0) = ^ J^'^l^ ^{Z^.n,e) and let Al{B) ^i- Y!IZi ^{Z,,e), where 
the Zi were introduced previously. We write 

A^{e) ~A = (A^ie) - A:M) + (Am KiOo)) + (AUOo) - A) (33) 

and we will handle separately the three terms on the right hand side above. The third 
term goes to a.s. according to the strong law of large numbers (SLLN for short) and 
by definition of the Zi and A. The same is true (uniformly in 6) for the second term, 
since part 3 of Lemma [2] implies 

sup \\AU9) - A:,i6o)\\ < f sup ll^-^oll) 63(^0. 
seB„ \eeB„ / ^ 

and the SLLN applies, thanks to part 4 of Lemma [2l It remains to study the first term 
of ([55)1 uniformly in 9 in order to prove (ITil) . We have 

a„(^)-a;(0) = -^a,(^), 

where the two components of (9) are 

Ali9) = -0-2^Z,,„(l + -rZ,,rJ9)-^ + 0-^Z,(1 + ^Z,/9)-' 

Kl{9) = -r9-^Z,^^{l + 7Z,,„/^?)^/^-i + r9-^Z,{l + ^Z,/9Y'''-\ 

We shall give details for A^(0) and the case a„ > (the case a„ < and the treatment 
of A|(0) can be handled very similarly). Let 5 > 0, 9 g]1 — 6,1 + 6[, and Vi denote 
(1 + '^Zi/9)^^ . Use of the Potter-type bounds (OBI) leads to the following bounds (for all 
e > and n sufficiently large), 

(1 + a^9-\l + €)-fUr'K,V,y' < (1 + -fZ„,/9)-^ <V^{l + a^9-^{l - e)^U^K,V,y' a.s. 

After multiplication by —9~'^jZi,n and another use of we obtain 

-9-^-/Z,V, {(1 + a„B~y' - 1} - an9~\l + e^UyKM^ + a„B-)-i 

< K\{9) < -9-^-fZ,V, {(1 + a„B+)-i - 1} - an9"^{l - ehU^K,V,{l + a„B+y^ 

where = 9'^ {1 - e^U^ K,V^ and B+ = 9-'^{l + €yuyK,V^. Let us handle the upper 
bound first. We find easily that (1 — 6)11^ < V^i < (1 + 6)11^, and therefore, by Lemmas 
inland [51 and assumption \fk^an 0, 

< sup max(a„B+) < (1 + e)(l + (5)(1 - (5)"i7a„ max f/^'^if, = o(l) a.s. (34) 
e-i|<5*<fc" ^<'=" 

Consequently, using (1 +a;)^^ — 1 = — a;(l + a;)^^, for n sufficiently large and uniformly 
in e]l — (5, 1 + (5[, we find (almost surely) 

< ^^^^EtAi^-umrK.) - ^^^^^i^EtAur-K.) - 0(1) 
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The lower bound can be handled in the same way. Note that (116)) is an immediate 
consequence of (fT4)) . 



4.2.4. Proof of 

Recall that Bn{9) = Y^tZi 5o(^i,n, ^ )5o(^j,«, and let 



where the Zi were introduced previously. We write 

B,,{9) ~ B = {B^{0) - B:{e)) + {B:{e) - B:{9o)) +{B:{eo)-B) (35) 

The third term in the relation above goes to a.s. according to the SLLN and by 
definition of the Zi and B. Let us deal with the second term. For 6 ^ Bn, there exists 
some 6** between 9q and 6 such that (using parts 1 and 2 of Lemma [5]) 



\Bi{e)-B: 



< 



i=l 



max(Gi(Z,))V3 gG2(Z0. 



Therefore, combining part 4 of LemmajH Lemma[5l and the SLLN, we see that \\B*^{d) — 
B* (6*0) II almost surely goes to as n— ^ 00, uniformly in e S„. 

It remains to study the first term of (j35l) uniformly in 9 in order to prove (|15l) . We have 
B„ie)-B:{e) = ^Y.AmgoiZ,,e) + -^^ A,(0)(.go(^.,0))* + ;^ X] A,(0)(A,(0))* 



i=l 



ri,„(^) + ri,„(0) + r2,„(0) 



with 



X{0)igo{Z,,e)Y 



Aj{9){\n{l + 7f ) - 7) AH^)((1 + if 

A2(^?)(in(i + 7f ) - 7) ^nmi + 7f )'■/■' 



i=l 



-J-] 



and 



A.(0)(A,(0))* 



/ (AH^))^ A\{B) A^{9) 

[ A}{e)AUe) (Af(0))2 

Considering the first element of the matrix ri.„(0), we have 



^E^::rAK^)(ln(l + 7f)-7)| < ^ i: THI. (^) ' Tt, (in (l + 7f ) - 7)^ 

and, applying the Cauchy-Schwarz inequality too for dealing with the other elements of 
Ti^n{0) and r2^„(6'), the convergence B„(6') - Bl{e) (uniformly for 6 e S„) will 
be proved as soon as we show that the means over i = 1 to fc„ of each of the following 
quantities are almost surely bounded uniformly for 9 £ Bn '■ 

2 / 2 / ,2,„^\ 2 



(l^(l + 7f)-7)^ (l+7f) 



1 

l-r 
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Using Lenima[2j we see that the first two elements of this hst are both uniformly bounded 
by |r- J2i=ii^iiZi))'^^^ which converges almost surely. On the other hand, according to 
relation ^ and since EiU^'^'^'K^) is finite (by Lemma E]), K'^ E'^Cii^} / an)"^ is 
uniformly almost surely bounded. Similarly the same is true for ^i^ii^f i^) / o-n)'^ , 
as weU as for k:^^ and the proof of ([15]) is over. 

4-. 3. Proof of Theorem]^ 

We proceed as in the start of the proof of Theorem [21 and consider that the variables 
Yi are the variables F~^{Ui) where iUi)i>i is an i.i.d. sequence of standard uniform 
variables. Recall that 

fen 

Z(7, fi) = 2 £ log (1+ < A(7, <J),9{Y^,J, a) >) . 
1=1 

Defining Z,^,, = Yi/aon, do = (70, 1), 9 = (7, s), and 

l{9) - 2£log(l+ < A(0),g(Z,,„,0) >) 

i=l 

where X{6) is such that 

7^ V (1+ < A(0),.g(Z,,„,0) >)"\g(Z,,„,0) = 0, 

2 — 1 

it comes that 1(^0, cron) — l{Oo) since g{Ziji,j, s) = g(Yi,j,aons). We thus need to 
prove that l{0o) converges in distribution to X^(2)- Following a very classical outline 
in empirical likelihood theory, it is easy to prove that this convergence is guaranteed as 
soon as we have the following statements (as n— >■ 00) 

, fc,. , fe,. 



1 t—± 
k 

g{Z,,,,eo) A AA(0,B), max|l5(Z,,„,0o)|l =op(yfc;) 



However, these statements are included in Proposition [1] and therefore Theorem [T] is 
proved. 

Note : Proposition [T] was stated under the assumption that r < 1/3, but in fact r < 
1/2 is sufficient in order to prove all the results concerning 9o only and not for 9 in a 
neighborhood of it (and the covariance matrix B is well defined and invertible as soon 
as r < 1/2). 



5. Conclusion 

This work deals with the problem of finding confidence regions for the parameters of 
the approximating GPD distribution in the classical POT framework, for general heavy 
tailed distributions (7 > 0). It is shown that the application of the empirical likelihood 
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(EL) method to the estimating equations of J. Zhang ( 2007[ ) yields confidence regions 
with improved coverage accuracy in comparison to the Wald-type confidence regions 
issued fi:om the CLT for some estimators of the couple (7, a) (including the maximum 
likelihood estimator). It is also observed that coverage accuracy is not always as good as 
one would expect, which means that this subject (and the related one of EL calibration) 
would need to be further investigated. 

A profile EL based confidence interval for the tail index is also obtained, and its 
performance in terms of co verage probability has b een co mpa red to that of the confidence 



interval (CI) described in IJ.C. Lu and L. Peng I (j2002l ) and IL. Peng and Y. Qi I (|2006l ) 



(which is known to perform better than the Wald-type CI based on the CLT for the 
Hill estimator). In some simulations, the interval of Lu, Peng and Qi shows better 
performance, but in others this performance is limited to a very short range of number 
kn of excesses : this instability with respect to fc„ is much less present for the CI based 
on Zhang's equations. 

We shall finish this conclusion with two remarks. T he first is that some of the method - 
ology of the proof of the profile EL result (inspired bv lY. S. Qin and J. Lawless 
could prove useful in other settings (Proposition [T] lists properties which yield conver- 
gence in distribution of empirical likelihood ratio when the observations form a triangular 
array). The second remark is that plug- in calibration could be an interesting subject to 
investigate for obtaining CI for 7, in particular in order to shorten computation time. 



6. Appendix 

Lemma 2. Let 7 > 0, r < 1/3 and, for 9 > 0, 

/ gliz,0) \ _ ( ln(l+7z/e)-7 \ 

If we consider, for some positive constants Ci, c'l, C2, C3 depending on r and 7, 

Gi{z) = ci (ln(l + 72) + (1 + -/zy/^ + c[f 

G2{z) = C2{z{l + jz)-^ + z{l + -fzy/^-^) 

Gsiz) = C3{z{l + jz)-^ + z{l + jzy/''-^ + z^l+-fz)-^ + z^{l+-fzy/^-^). 

then there exists a neighborhood of 9q = 1 such that for all 9 in this neighborhood and 
Vz > 0, 

1. \\go{z,9)\\^<G,{z) 

2. \\^{z,9}\\<G2{z) 

3. \\^{z,9)\\<Gs{z) 

4. If Z has distribution GPD('-/,1) , then'K{Gj{Z)) is finite for each j S {1,2,3}. 

Proof of Lemma \^ : we shall first give details for part 1, since parts 2 and 3 can be 
treated similarly. 

We shall bound from above |(;q(z,(?)| and |(7o(^i^')| in the neighborhood of 6*0 = 1. For 
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5 > and E [I ~ 5,1 + 5], we have, 



In 



+ Tfj)-^'^-'S<^-'"^'°0 + T^ 



and if r < (the case r > is similar) 

According to Lemma [H if wc take 5 < ^, we thus have (for some positive constant c) 

|ffi(z,0)| <ln(l + 7z) + 7 + hi(3/2), and \gl{z,e)\ < c{l + ^zf/^ + j^. 
This concludes the proof of part 1. 

If U is uniformly distributed on [0,1], then it is easy to check that the expectations 
E[(ln(l + "fZ)y{l + 7Z)''''/t] = 7°E[(-lnC/)°C/~''''] are finite for every a and b in 
{0,1,2,3} because we assumed that r < 1/3. Therefore M{Gi{Z)) is finite. Similar 
simple integral calculus leads to the same conclusion for E,{G2{Z)) and E(G'3(Z)). 

Lemma 3. Let 7>0, aSM, /3>G and U a uniform [0, 1] random variable . 
{i) // 1 - a - 7 > 0, then E([/-°X^,p(i)(- In U)^) is finite. 
(m) //l-a-27>G, thenE{U-°'K^p{j^)i~lnU)f^) is finite. 
Proof of Lemma\^ : we have 

K-rA^) = i(T£-f)+^ if7 + Py^0andp^0 
= (lux- ^2Z_J.) if 7 + P = and p 7^0 

= Jj(x^(7lna;-1) + 1) if p = 0. 

We consider statement (z) and provide details only for the case 7 + p and p 9^ (all 
the other cases being handled the same way). A simple change in variables readily gives 

E{U-"K,J^){-lnUf) = -^/+-exp((« + 7 + p-l)y)/ dy 

~^ Io°° '^^P ((a + 7 - 1)2/) dy 
+:^(^ /o^°° exp {{a - l)y) / dy. 

But /g^°° e"^ y^ dy being finite if and only if u < 0, this concludes the proof of (i) since 
7 is positive and p is negative, in this case. The proof of statement (ii) involves the same 
arguments and is thus omitted. 



Lemma 4. Let 7 > 0, z > and S E [0, 1/3]. Then, 

< ln(3/2) 



1 1 + 1^ 3 



1±<5 



In I 1 + ) - ln(l + 7z) 



2 2 
Proof of Lemma^ : since 

1 + 72 I + 0I + 7Z I + 7Z 1 — (51 + 72 

21 



it is clear that the first ratio is between ^ and 1 and the second one between 1 and |. 
The second statement conies from 

which absolute value is bounded by ln(4/3) ior d — S and by ln(3/2) for d = —S, since S 
is assumed to be in [0, 1/3]. 

Lemma 5. Let (fc„) be an integer sequence such that kn — > +oo. If {Zi)i>i is an i.i.d. 
sequence of non-negative random variables such that ¥.{\Zi\P) for some p> 0, then 

max|Zj| = o{kl/P) almost surely, as n~-> co. 

i<kn 



Proof of Lemma\^ : mimicking the proof of Lemma 11.2 in lA.B. Owen ( 2001 ). we find 



that maxj<„ \Zi\ — 0(71^/^) almost surely and thus it is also true on the subsequence 
(fc„), so the lemma is proved. 
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